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We consider a generalization of the 2-dimensional (2D) quantum-Hall insulator to a non-compact, 
non-Abelian gauge group, the Heisenberg-Weyl group. We show that this kind of insulator is actually 
a layered 3D insulator with nontrivial topology. We further show that nontrivial combinations of 
quantized transverse conductivities can be engineered with the help of a staggered potential. We 
investigate the robustness and topological nature of this conductivity and connect it to the surface 
modes of the system. We also propose a simple experimental realization with ultracold atoms in 3D 
confined to a 2D square lattice with the third dimension being mapped to a gauge coordinate. 

PACS numbers: 37.10.Jk, 03.65.Vf, 73.43.Nq 



I. INTRODUCTION 

In recent years there has been a huge interest in topo- 
logical states of matter and related external gauge fields 
realized with ultracold atoms on a 2-dimensional opti- 
cal lattice. Historically the way has been paved by the 
study of rotating optical lattices, where the centrifugal 
force, appearing in a frame co-rotating with the lattice, 
acts as an artificial magnetic field (see Ref. [l] for a re- 
view). To reach topologically nontrivial phases, however, 
needs a large magnetic field, which falls outside of the 
reach of rotating lattice experiments. Later a scheme 
has been proposed theoretically by Jaksch and Zoller [2 , 
in which a strong artificial magnetic field can be created 
with the help of stationary optical forces, and the Hofs- 
tadter butterfly can be observed. Several modifications 
of this work appeared recently to overcome some difficul- 
ties or to generalize it to non-Abelian gauge potentials 
(SU(2)) [IHS] giving rise to energy spectra with peculiar 
self-similarities beyond the Hofstadter butterfly [H [7] or 
to topological transport properties [7HT2]. Very recently 
Abelian gauge fields have been realized experimentally as 
well [131114]. 

Probably the simplest paradigmatic example of topo- 
logical transport is the integer quantum Hall (IQH) effect 
[15] taking place at low enough temperatures. By vary- 
ing the magnetic field perpendicular to a 2-dimensional 
semiconductor, which also has an electric potential differ- 
ence between two opposite edges, one can notice a trans- 
verse current. The transverse conductivity (TC) takes 
only quantized values and is proportional to the winding 
number of the Berry's curvature of the many-body wave 
function [16 . Soon after the topological considerations 
of two-dimensional insulator phases the theory has been 
generalized to three dimensions where the TC is a ten- 
sor [T7l[T8]. However, in three dimensions one usually 
suffers from the collapse of the energy gaps and the sys- 
tem remains an insulator only in special situations. An- 
other generalization of the IQH effect to higher degrees 
of freedom is to stack more layers of more or less inde- 
pendent quantum Hall insulators (QHI) on top of each 



other. Since inter-layer tunneling is small well developed 
gaps remain. A lot of work has been devoted to study 
the effects of bi- or multi-layer structures on the quan- 
tum Hall effect, especially the fractional one [T9l|20]. In 
bilayer graphene the TC plateaus were studied and a new 
type of IQH effect was found with a zero-level anomaly 
interpreted by a 2it Berry's phase of the charge carriers 

Despite the above successes of realizing synthetic gauge 
fields with ultracold atoms, non-Abelian gauge groups 
have not yet been achieved experimentally. Here we pro- 
pose a scheme where the difficulty arising from the multi- 
component nature of particles sensitive to a non-Abelian 
gauge field is overcome quite naturally by mapping the 
gauge index to an external coordinate, thus rendering the 
realization of a non-Abelian external gauge field experi- 
mentally easier. The external coordinate is the position 
in a perpendicular direction. Depending on whether the 
extension of the system is finite or infinite in this direc- 
tion, one can realize compact, or non-compact external 
gauge groups, respectively. In this paper we consider the 
non-compact case. We propose therefore an experimen- 
tal scheme with single component ultracold atoms in a 
3D optical lattice with cubic geometry but anisotropic 
hoppings to mimic the behavior of a 2D system but with 
(possibly) infinitely many internal states. 

Until now not much interest has been directed towards 
non-compact gauge groups, which is mainly rooted in 
that these gauge groups have ill defined invariants (such 
as Wilson loops) and therefore their dynamics cannot be 
formulated in a gauge invariant manner. However, as ex- 
ternal fields they can induce topological phases with pe- 
culiar transport properties. The question is what kind of 
physics does it yield, and what can be their physical real- 
ization? This paper answers positively to both questions. 
Here we study the effects of the simplest non-compact 
gauge group, namely the Heisenberg-Weyl group (HWG), 
which is generated by two elements, say z and p, with 
the canonical commutation relation [z^p] = i. As a con- 
sequence of non-compactness this commutator cannot be 
represented in finite dimensions. We show that in spite 
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of the above difficulties this gauge group can be real- 
ized relatively simply with today's technology of ultra- 
cold fermions and optical lattices by identifying the role 
of the HWG in layered 3-dimensional lattice systems. We 
provide the phase diagram of the system. We also show 
that the multilayer structure provides further prospects 
beyond the zero level anomaly, such as a significant tun- 
ability of the positions and strengths of the quantum Hall 
plateaus. In a possible inter ferometric application such a 
strong transverse conductivity can, in principle, enhace 
the precision of the measurement. 

The paper is organized as follows. In Sec. II we start 
our discussion with the 2D Hamiltonian describing non- 
interacting fermions in the presence of a general, pos- 
sibly non-Abelian an non-compact, gauge field. This is 
the Hamiltonian we would like to simulate in ultracold 
atom experiments. We give a mapping of the gauge co- 
ordinate to the external z-direction, thus extending the 
spatial dimension by 1, and simultaneously reducing the 
wave function to a single component one. This mapping 
is the key point for experimental realization. We analyze 
the transport properties specific to the vector potential 
of our choice and relate the results to those of the IQH 
effect. In Sec. HI we show that with the addition of 
a staggered scalar potential the transport properties can 
be modified drastically and give the phase diagram of the 
topologically insulating states. In Sec. IV we study the 
effects of some possible imperfections in the experimental 
applications, namely some small but nonzero inter-layer 
tunnelings and discuss the robustness of the phase di- 
agram with respect to these imperfections. Sec. V is 
devoted to the experimental proposal and Sec. VI for 
summary and discussions. 



II. LATTICE HAMILTONIAN IN AN 
EXTERNAL GAUGE FIELD 

Our goal is to study topological transport properties 
of fermions confined in 2D and immersed to an exter- 
nal magnetic field generated by non-Abelian and non- 
compact gauge fields. To make the presentation more 
transparent and to show how a dimensional extension 
can be carried over we start our discussion with the 2D 
Hamiltonian of multicomponent fermions inside a peri- 
odic potential. We suppose that: 1) the fermions are 
non-interacting, which in experiments can be achieved 
e.g by Fesbach resonances; 2) the optical lattice is suffi- 
ciently deep, therefore a tight-binding model can be used. 
The tight-binding Hamiltonian in second quantized form 
reads as 

+ Ul^, (m, n) c]^,n,aCm,n+l,a' + H.C.^ , (1) 

where Cm,n,a is the fermion annihilation operator at po- 
sition r = mbex -\- nbcy {b is the lattice spacing), and 



with gauge coordinate (internal state) a. The hopping 
amplitude is given by t. The position dependent unitary 
matrices U^{m^n) and [/^{m^n) are the lattice counter- 
parts of the components of the vector potential A{f) of 
the continuum system, and are obtained by the Peierls 
substitution 



Uy{m,n) = 



exp I 



exp z 



^ rm + l,n 



(2a) 
(2b) 



a, a' 



In the case of standard electrodynamics, where the gauge 
group is Abelian, the tunneling operators are ordinary 
site dependent phase factors. When the gauge group is 
non-Abelian but compact they become unitary matrices 
with finite dimension. Here we choose them to be el- 
ements of the HWG, which is non-compact, and does 
not have finite dimensional representation, therefore the 
tunneling matrices become infinite dimensional. Here we 
consider the following choice 



(3a) 
(3b) 



The operators z and p obey the commutation relations 
mentioned in the introduction, and they act on the in- 
ternal space by zCm,n,a = crcm,n,a, and e'"^c^,n,a = 
Cm,n,cr+Q!, i-e. i is a diagonal operator (the position), 
while p is the generator of translations in the internal 
space. The x — y position dependence of the vector poten- 
tial has been chosen here similarly to the Landau gauge, 
which in the case of U(l) electrodynamics gives a homo- 
geneous magnetic field important for the quantum Hall 
effect. The numeric parameters a, /3, and 7 are real 
numbers, which can be controlled experimentally and are 
measuring the fiux penetrating each plaquette. 

Let us consider that the gauge coordinate a is actually 
the real external z direction. Let us further assume, that 
the z direction also supports a sufficiently deep optical 
lattice with lattice spacing b' . So the 2-dimensional prob- 
lem with infinitely many internal states is mapped to a 
true 3-dimensional problem, where the position is given 
hy f = mbcx ^ nbcy ^ a b' Cz. Since a particle can hop 
only from site to site - even in the z direction -, there- 
fore a has to be integer times the lattice spacing. By 
considering the simplest choice, a = b^ , then U^{m^n) 
is just the translation operator in the z direction by one 
lattice site. The first term in the lattice Hamiltonian 
([1]) therefore takes the form /7^(m, n)cj^ ,^^^Cm+i,n,cr' = 
^m+i n cr-i^rn+i,n,cr- Accordingly the tunneling processes 
in the xz plane are special; if the particle tunnels in the 
X direction by one to the left (right), it has to tunnel one 
position in the z direction up (down) too. Hence it is 
convenient to introduce new coordinates: ^ = (m — <j)/2, 
and ?7 = m + cr, so the Hamiltonian takes the following 
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FIG. 1: (color online) a) The schematic illustration of the 
new coordinates, the system splits into independent quantum 
Hall layers. b)-c) The DOS for = 1/4 as a function of 
the energy. In subfigure a) each different r\ plane contributes 
equally to the DOS. In b) the value of the staggered potential 
in Eq. ([7| is chosen to be A = 2.21. The net TCs are shown 
on the figure for each band gap. 



form: 



H 



(4) 



The phase factor acquired by tunneling along the y- 
direction reads in the new coordinates as 



9y = 2n/3'^ + nj'7i, 



(5) 



with the definitions = /3 — 7, and 7' = /3 + 7. As there 
is no tunneling along the 77-direction, Eqs. (|4| and ([5| 
describe independent 2-dimensional IQH systems layered 
on top of each other. Each layer behaves similarly, except 
for 77 even ^ takes integer values and for r] odd ^ takes half 
integer values. The tunneling phase Eq. ([5| depends also 
on 77 (the quantum number indexing the different planes) . 
Refer to Fig. [l]a) for illustration. 

It is convenient to choose P' as a rational number: 
= p/q with p and q co-prime integers. In this case 
the Hamiltonian is invariant under translations in the 
^ coordinate by q lattice positions, homogeneous in the 
y direction, while 7^ is a conserved quantity. For illus- 
tration we have calculated the density of states (DOS) 
for — 1/4 by direct diagonalization and plotted in 
Fig[l]b). As a consequence of the = 4 periodicity in 
the ^ direction, the energy spectrum is composed into 



g = 4 bands which are the lattice counterparts of the 
Landau levels of the continuum case. The central two 
bands shows the features of a Dirac cone like touching. 
When the Fermi energy lies inside a band, the system is 
metallic and has a non- vanishing longitudinal conductiv- 
ity. In contrast, when the Fermi energy lies inside a gap, 
the longitudinal conductivity is zero, and quantum Hall 
effect can take place: the transverse conductivity is inte- 
ger times the conductivity quantum. Since the spectrum 
is independent of 7^, the effect of layering is just a degen- 
eracy in the spectrum by the number of planes. For these 
(longitudinally) insulating phases the transverse conduc- 
tivity of each plane is given by the TKNN formula [16] : 



2^/ 



775 



(6) 



with = V]^ 



N 



X A 



n the Berry's curvature, and Ar^ 

(r) 



is the Berry's connection cal- 

(r) 



culated for the occupied one particle Bloch states u^.^ 
at plane rj. We have computed the transverse conductiv- 
ity with the efficient algorithm of Fukui et al [22 . The 
transverse conductivity takes only integer values since 
it is a topological invariant: the first Chern class of 
the U(N) principal bundle over the Brillouin-zone torus 
(k^^ky). Furthermore at every r] plane the transverse con- 
ductivity can be only 0, 1 or —1, depending on whether 
the Fermi energy lies outside the band structure (in this 
case the lattice is either empty or fully filled and the 
conductivity is zero), or it lies inside a gap between the 
satellite bands and the central band (for negative ener- 
gies the transverse conductivity is negative and for pos- 
itive energies it is positive for our model and choice of 
parameters). Accordingly, when we add up all of the 
contributions to the TC from each of the planes we get 
zero if the Fermi energy lies outside the band structure, 
or we get a± = = ±2r, where 2r is the number of 

planes, what we choose to be even. We have also shown 
in Fig. [l]b) and c) the net TC of the band gaps. 

III. EFFECTS OF A STAGGERED POTENTIAL 

The above combination rule of the TC can be con- 
trolled in a striking way by applying a staggered potential 
of strength A, added to the Hamiltonian as 

i/A=J^H + A^(-ir4„„C5,^,„, (7) 

which shifts the energy spectrum locally by ±A for the 
even/odd planes. In Fig. [l]c) we have plotted the result- 
ing DOS for A = 2.2t. Note, that the original degeneracy 
is partially lifted by the 2A energy difference of the planes 
with different lambda parities. One can imagine as we 
start to increase A from zero to a finite value that the 
original 3 bands start to widen and then separate, since 
the one particle energies on the even r] planes are get- 
ting bigger, while those on the odd r] planes are getting 
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FIG. 2: (color online) The phase diagram of the system in the 
Fermi energy - staggered potential plane (measured in the 
hopping strength). Subfigure a) corresponds to the Hamilto- 
nian ([7|. Subfigure b)-d) correspond to Eq. ^ with e = 0.1 
b), e = 0.5 c), ande = 1.0 d). The flux is taken to be = 1/4. 
The hatched regions represent areas where either the even or 
the odd planes are metallic. 



smaller. The phase diagram in the {Ep^ A) plane is plot- 
ted in Fig. [2] a) . One can get a grasp of the structure 
by imagining that the 3 energy bands of Fig. [l] b) get 
shifted by ±A providing 3 tilted stripes of metallic be- 
haviour for the even and and another 3 stripes (tilted to 
the other direction) for the odd planes. At the intersec- 
tions of the stripes all of the planes are metallic at the 
same time. In the insulating regions, i.e. when the point 
{Ep, A) lies outside of the metallic stripes, the net TC is 
the sum of the contributions of the even and odd planes: 
a± = <Je + ctq. With the variation of A one can achieve 
that the Fermi energy falls into different band gaps for 
the even and odd planes, where (jg ^ ctq. In the = 1/4 
case the gaps are characterized by a^^o = {0? +r, 0}. 
Therefore one can have (j± = — 2r if both set of planes 
have cTg^o = and a± = +2r for (jg^o = Zero net 
TC is realized in two ways: either by cre,o = 0, or by 
cTg = —(Jo- In this latter case the even and odd planes 
have opposite transverse conductivities, which is similar 
to the spin quantum Hall effect (for a review see Ref. 
[23^). There is an important difference though: in our 
case the net TC is an integral number, not just a Z2 
invariant, the higher is its value the greater is the trans- 
verse current. If a quantum phase transition is induced 
either by the change of the Fermi energy or by the varia- 
tion of A, the TC changes at least by half of the number 
of planes, not just by one conductance quantum. 



FIG. 3: (color online) The edge states. In situation a) all of 
the planes are in the same spectral gap, therefore the edge 
states of the different planes contribute equally to the trans- 
verse conductivity; in b) half of the planes is either metallic, 
totally empty or completely filled thus lacking the edge states, 
while the other half of the planes have a TC of 1; in c) the dif- 
ferent parity planes have oppositely propagating edge states; 
in d) all of the planes are either metallic or trivial insulators, 
there are no edge states in this case. 



Another physical picture can be assigned to the insu- 
lating regions of the phase diagram based on the bulk- 
boundary correspondence [24]: by considering the x di- 
rection finite, when the Fermi energy is inside a bulk gap 
with nonzero TC, edge states (responsible for the trans- 
verse current) traverse the energy spectrum between the 
two bulk bands surrounding the gap. In the = 1/4 
flux phase one can have a maximum of 1 pair of edge 
states per plane and the direction of their propagation is 
determined by the sign of the TC. Fig. [3] shows a qual- 
itative picture of the possible edge state configurations. 
In subfigure a) all planes are in the same QHI phase and 
the transverse currents carried by the edge states add to- 
gether 'constructively'. Such a situation corresponds to 
the two diamond shaped regions with a± = ±2r of Fig. [2] 
a). In subfigure [3] b) every second plane is in a QHI phase 
while the other half of the planes are either in a metal- 
lic or in a normal insulator phase. Therefore a± = ±r 
and the corresponding regions in the phase diagram are 
those marked out by the IQH stripes (except for their in- 
tersecting diamond shape regions). The situation in Fig. 
[3] c) , where the edge states of the neighbouring planes 
are counter-propagating, is situated in the intersections 
of the oppositely transverse conducting IQH stripes of 
Fig. [2] a). The net TC is zero and an analogy with quan- 
tum spin Hall insulators can be established [23j. 



IV. INTERPLANE TUNNELING 

In experiments with ultracold atoms in anisotropic 3D 
lattices it is possible, that the inter-plane tunneling is not 
exactly zero, and therefore the HWG is realized perfectly. 
Therefore an analysis of the robustness of the accumu- 
lated TC is needed. One introduces tunneling between 
the different planes (in a controllable way) by adding an 
extra term to the Hamiltonian: 

Hx,e = + e ^ (cL,nC^,^+l,n + H.C.) , (8) 
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FIG. 4: (color online) The phase diagram for e = 0.5, = 1/4, 7^ = P /q\ with q —1 and = 0, 1, 2, 3, 4, 5, 6, 7 from a) to h). 



then r\ will not be a good quantum number any longer, 
and consequently of the individual planes looses its 
meaning. As an effect of the e strength inter-plane 
hopping the eigenstates of the different r] planes get 
hybridized and the conducting regions get widened as 
shown in the phase diagram Fig|2]b)-d). However, while 
e is sufficiently small, the gaps persist and the net a ^ 
keeps its significance. In this case the Brillouin zone is a 
3-dimensional torus and one needs to make 2-dimensional 
slices to get topological invariants [18]. In our case the 
only nonzero invariant is the one with slicing along a 
constant /c^ value. (For nonzero values of the other com- 
ponents of the conductivity tensor one needs first a gap 
closing and than a reopening.) As the inter-plane tun- 
neling amplitude is raised the QHI regions shrink and 
give way to the metallic phase. There is a competition 
between the staggered potential strength A and the tun- 
neling strength e. Therefore the high transverse conduc- 
tivity QHI regions vanish first (around tc ~ 0.8) since 
they are located around A = 0. 

When e 7^ the edge currents are not protected against 
back-scattering by any discrete symmetry, in contrary to 
the case of the spin QHIs. If the state of the system is 
located in the = islands inside the metallic stripes, 
corresponding to the alternating transverse edge current 
setup of Fig. [sjc), then inter-plane tunneling causes an ef- 
fective back scattering, and the originally massless Dirac- 
like dispersions of the edge states develop mass gaps. The 
edge states of the other IQH regions (a ^ 7^ 0) retain their 
topologically protected nature and the massless touching 
of their Dirac cones. 

So far we have not yet studied the consequences of 
varying the 7' flux parameter of the vector potential ([5| . 
While e = the distinct planes are independent and the 



inclusion of 7' 7^ does not change the transport proper- 
ties. In Fig. |2j the first panel corresponds essentially to 
uncoupled layers with constant synthetic Abelian mag- 
netic field. This is because the HW gauge potential is 
restricted to e = 0. In contrast, in Fig. [4] the full non- 
Abelian nature of the HW group is considerd by setting 
7' 7^ together with e 7^ 0. The first panel again essen- 
tially reduces to the case of constant synthetic Abelian 
magnetic field, but for the coupled layers. The follow- 
ing panels illustrate then the effects of non- Abelian HW 
gauge fields on the conductivity in coupled layers. This 
effect consist in appearance of novel insulating islands 
with transverse conductivities equal to ±3r in these new 
regions, which are bigger then those for 7' = 0. It con- 
stitutes one of the improtant results of this paper. 



V. EXPERIMENTS 

The experimental realization of the HWG is straight- 
forward. According to Eq. Q one needs to create a 
3-dimensional optical lattice with cubic geometry in 2- 
dimensions — y planes) and an AB type layering in 
the 3rd {r]) direction. The gauge potential (|5| is actually 
just a phase in this basis, and therefore it can be realized 
in the usual way [2l |3l E]. One only needs a staggered 
potential along the 3rd (7^) direction and a control over 
the tunneling amplitude along this direction. All of these 
elements are in the reach of current experimental tech- 
nologies. The detection of the transverse conductivity 
and the edge states is a currently running issue. There 
are 3 proposals what we are aware of: a) by changing the 
atomic isotope to a bosonic one, loading them into and 
finally imaging them in the edge states [10 , b) with the 
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help of stimulated Raman scattering one can measure one 
particle excitations directly [25^, and c) with the help of 
Bragg scattering one can directly measure the dynamical 
structure factor and hence also the single particle exci- 
tations [26 . Another proposal for the detection of the 
edge states in the presence of a trapping potential con- 
sist of creating a sharp interface, e.g. by controlling the 
hopping in the y direction and exciting the edge state 
channel by a focused laser beam [12,. 

VI. SUMMARY AND DISCUSSION 

In this paper we have shown that the problem of 2- 
dimensional lattice fermions in an external non-compact 
Heisenberg gauge group is equivalent to an experimen- 
tally realizable, layered 3-dimensional Abelian quantum 
Hall system. Thus we have given a theoretical proposal 
for realizing non- Abelian and non-compact gauge groups 
with ultracold atoms in an optical lattice with phase im- 
printing techniques only. We have considered its advan- 
tages in engineering different QHI phases by varying the 
gauge potential and another external staggered poten- 
tial. As an example we have calculated the phase dia- 
gram for the Abelian flux of 1/4 per plaquette and re- 
lated the bulk topological properties to the edge states 



of open boundary conditions. We have also shown that 
by varying the other flux parameter one can achieve a 
non- Abelian character when the layers are coupled suf- 
ficiently strongly. Layered fermion systems are encoun- 
tered in many corners of condensed matter physics and 
our motivation was to find new insulating phases with 
nontrivial topologies to get a better understanding on the 
possible complicated phase diagrams found in such sys- 
tems. In this respect our analysis opens a viewpoint on 
layered systems, where the layering can be understood 
as an additional gauge potential on a system with re- 
duced dimensions. Concerning practical points of view, 
the robustness of the topological quantization of measur- 
able quantities can lead to metronomy standards or to 
applications in quantum information processing. 
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